a \ Middle East Journal of Applied Science & Technology 


M E J A S T Vol.5, Iss.2, Pages 09-16, April-June 2022 


M. Mohankumar', S. Akilan’, B. Hariprasath’ 7 Re Ariprasath* & §. Dhanu Dharsan” 


'Department of Electronics and Communication Engineering, Sri Eshwar College of Engineering, Coimbatore, Tamilnadu, India. es Crossref 
DOI: http://doi.org/10.4643 1/MEJAST.2022.5202 


Copyright: © 2022 M.Mohankumar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which 
permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 


ABSTRACT 


1. Introduction 


Image fusion is widely employed in various industries, including medical imaging, surveillance applications, 
biometrics, and so on. It's the process of integrating similar data from two (or more) photos into a single image. 
After that, the final image has more information than the input photos. Various sorts of sounds distort 
multi-resolution images obtained by various image fusion cameras. Before processing, a cost-effective VLSI 


architectural technique for distortion correction should be used [1]. 


Distortion can be caused by a variety of variables, such as the over-the-band effect in camera lenses, radial (or) 
barrel distortion, and so on. Traditionally, distortion correction is performed only after the image has been taken, 
and a separate image processing system is required for fusion. In this paper, we present a circuit architecture that is 


linked to end-user camera equipment. The back-mapping technique reduces distortion correction. 


A polar coordinate transformation can be converted to Cartesian coordinates using Horner's technique [2]. Back 
mapping provides for less hardware and power usage, as well as a reduction in computational complexity. Circuit 
for linear interpolation, the proposed architecture in this study is meant to accomplish minimal power and memory 
needs, as the circuit employs a SOC-based RAM bank. When working with raw medical photos, distortion 
reduction is a must. Large discrepancies can be caused by even minor distortions. As a result, pre-processing the 
image is required before combining numerous photos. In this situation, barrel distortion has ruined the photographs 


[3]. In this stage, we will repair the image in two steps. 

STEP-1: Converting CIS pixels to DIS pixels. 

STEP-2: The intensity is calculated via linear interpolation, each pixel in CIS. Initially, this transformation converts 
all pixels in the image's rectangular coordinates to polar coordinates. Back mapping is therefore required to lessen 


the complexity of computations and coordinate transformations (from polar to rectangular). The angle of the lens 


from the reference plane is determined in this study, and it is utilized to correct barrel distortion. The technique of 
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Least Mean Square Estimation (LMS) [4]. We reduced the square root operation. We present an algebraic 


manipulation method for reducing linear interpolation's arithmetic resource. 
R - Rectangular coordinate. 
P - Polar coordinate. 


MRI - Magnetic Resonance Image. 


CT - Computed Tomography. 
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Fig.1. Distortion correction scheme 


For image fusion, a deformed and noise-free image is provided. Even though there are a variety of ways for image 
fusion, we employ the discrete wavelet transform to fuse images [5]. For making use of picture fusion, this pixel 
transformation approach saves time and may be used with any software program. Digital filtering is used to 
produce the pixel time scales. The signal decomposed using high pass and low pass filters in the approximation 
technique. We're using two input photos (x 1 and x 2) that are overly fused together in this case. The raw images are 
then turned into wavelets using the HARR wavelet transform (W). The converted image coefficients are processed 
using a suitable fusion role to lower the noise level. Finally, to create a fused image, inverse wavelet transforms (W 


(-1)) are utilized. 


As a result, each pixel in Distortion Image Space (DIS) is converted to Corrected Image Space (CIS), and the 
rectangle coordinate is converted to a polar coordinate. The "center of distortion" determines the distortion center. 
A distortion center (i.j;) is known as a polar coordinate (r', ®') in polar coordinate systems, and the distance r 


between a distortion center {i,.j,)and an image pixel (é.j") is expressed as, 


r= \G-8F +0 iF a) 
o' = arctan (14) 7 
ie Ty 


The distance r between the distortion centre (i, j) and the picture pixel is given by, 


r= (@-i,)?+G-iF GB) 
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The angle formed by the pixel and the distortion center is, 


Th (4) 


—i, 


0 = arctan (: 


Back-mapping is the second phase in our distortion process. The pixels (r®’, &') in the Corrected Image Spaces 
(CIS) are translated to the pixels (1',’) in the Distortion Image Spaces (DIS). The link between 'r' and r degree N 


stated as is determined using an expansion polynomial. 


N 
r=) cap” 

2, (5) 
v=0 (6) 


Because the expansion coefficient may be computed using nonlinear radial stretching [6], Around the distortion 
center, the distortion is regarded to be totally radial, with an equal angle. In Corrected Image Space (CIS), the new 


location (i’, j’) is computed as, 
i=i,+rcos® (7) 
j=j, +rsin® (8) 


The third step involves transforming the polar coordinate into rectangular coordinates to correct the distortion in the 


C219 6nd 


processing approach. The alteration of the position (‘i”, ‘j'’) in Distortion Image Spaces (DIS) is expressed as, 
i’ =i', +r’ cos (9) 
j =j,+r'sino (10) 


ers 


In Distortion Image Spaces, based on linear interpolation between intensity values of four nearest pixel (‘i",'j") in 


region (DIS). 
A. Polar to Cartesian Coordinate Conversion and Back-Mapping Procedure 
Back-mapping module translates pixel (r,) in CIS to its DIS equivalent (‘r’,). 


Here, N stands for polynomial degree. 


N 
(11) 
r =) d,p™ 
n-—i 
v=9 (12) 


B. Analysis of Polynomial Approximation 

It may be used to approximate the back-mapping expansion polynomial to polynomials of even or odd order. 
r =Cort+ Cyr? + Cyr? +-—+C,7™ (13) 
r’ =Chor? + Cbhyr*+--.+Cbyr" (14) 


Where, C_0, C_1, or CB_0, Cb_1, refers to the back-mapping polynomial with odd or even-order coefficients. 
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C. Back-Mapping Procedure Simplified 

The odd-order polynomial may then be approximated using the back-mapping expansion polynomial. 
r’ =egr +eqr® + cpr* + er’ + (15) 

The block diagram of the structural design is shown in 


sin @’ =sin@ = 


i-h (16) 
r 


cos @ = cos G = 


i—i, (17) 
r 


The square-root computation for r can be omitted because there are no odd powers of r in equation. 


ee t-t 
i=i,+r’ — 


si i-i 

= i+ (corteyr®+egr*+ezr’ tegr’+...)* =a 

= iyt (egteyr’ tezr*+eqr*+egr*+. * .)x {i = iy) 
fel 


Its 


—_ 7 L ra 5 ——= 
jit (Corteyr*+eyr*tegr’ +egr’t...)X = 


= jit ( egteyr’+egr*+ezr®t+cqr*+...)X G-diu) 


2. VLSI Architecture 


The linear interpolation unit will have a 6-stage pipelined design, whereas the mapping unit will have a 15-stage 
pipelined architecture [8]-[13]. In rectified image spaces, the mapping unit will manipulate (‘u’'", ‘4v') for each 


pixel (u, codetermine). 
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Fig.2. Proposed VLSI Architecture 


In 15 stage pipelined architecture and 6 stage pipelined architecture we use 19 multipliers, 12 adders and 2 sub 


tractors. 
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Fig.3. Map unit pipelined architecture 


Most of the adders and multipliers are adopted 24-bit width [7]. The design structure formed to achieve high speed 


and less complexity, 
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Fig.4. 6 stage pipelined architecture of Linear Interpolation unit 


A. MATLAB DWT Architecture 


The figure depicts the use of a DWT-based image fusion approach to create fused images from two (or) multiple 
photos. There is some imaging capability in this. The wavelet transform is used to convert the input signal into a 
time-frequency representation. The wavelet transform was created as a replacement for the short-time Fourier 
transform. We analyse dissimilar frequencies with numerous resolutions at different frequencies using the 
multi-resolution technique in wavelet transform. The suggested system reads images as text files. The MATLAB 
GUI interface is used to convert text files. Our DWT picture fusion uses filter banks calculated from discrete 
wavelet transforms to imitate the behaviour of continuous wavelet transforms. The pixels are sorted according to 
intensity using mathematical analysis after the signal has been processed using a filtering with a high and low pass. 


The K-Level decomposition in the wavelet transform has one low frequency component (LL band) and three high 
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frequency components (LH bands, HH bands, and HL bands). From the fusion of wavelet coefficients L, HL, HH, 


LH, an inverse discrete wavelet transform is utilised to rebuild the reconstructed fused image [9]. 


Registered Wavelet coefficients 
input images 


Fig.5. Scheme of image fusion using DWT 
B. Results of Image Fusion 


The fused images are made up of two (or more) different images. As a result, 3x3 matrices are used to track the 
images. The first three photos, mask (331), bust (332), and Catherine (333), are used as input images with 
(256x256) resolution (333). Figures (334) and (335) represent inputs of mask and bust, Figures (336) and (337), 
respectively, represent inputs of bust and Catherine, and Figures (338) and (339), respectively, represent the inputs 
of Catherine and mask. The mean-mean and max-min fusion rules are applied to the output. The output is in the 


form of a mean-mean and maximum-minimum synthesis. 
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Fig.6. The output of image fusion 
3. FPGA Implementation 


The machine imports the raw image into the system. The programme that runs the system (i.e.) MATLAB GUI 
converts the image file into the text file. The text file then proposed with DWT. Our VLSI architecture gets this 


input for distortion correction. 
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Fig.7. FPGA implementation process 
4. Conclusion 


The rigid image registration using wavelet based image fusion was performed using CT and MRI images. The 
quality of the images obtained by this technique has been verified using the Correlation Coefficient. The original 
input images and their corresponding registration and fusion results using the proposed technique are depicted in 
detail. The intensity based registration method was applied to the two input images, the quality of the registration 
was measured using the Correlation function to measure the similarity between the images before and after the 
registration the values of the correlation were displayed in percentage and the elapsed time taken for the registration 
process was also displayed, then the wavelet based image fusion algorithm was applied to the registered and 
reference images, the images were then decomposed and certain fusion rules were applied, finally the inverse 
decomposition was done to obtain the final fused images that contain information from both images. The quality of 
the fused images using the different fusion rules was done by measuring the Correlation Coefficient for each image 


fusion rule, and the resultant images are shown in the part of the result. 
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